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Abstract. The asymptotic properties of the memory structure of ARCH(oo) 
equations are investigated. This asymptotic analysis is achieved by expressing 
the autocovariance function of ARCH(oo) equations as the solution of a linear 
Volterra summation equation and analysing the properties of an associated re- 
solvent equation via the admissibility theory of linear Volterra operators. It is 
shown that the autocovariance function decays subexponentially (or geomet- 
rically) if and only if the kernel of the resolvent equation has the same decay 
property. It is also shown that upper subexponential bounds on the autoco- 
variance function result if and only if similar bounds apply to the kernel. 



1. Introduction 

The significant influence of past data upon current and future values of a time 
series is evidenced in many time series from the physical sciences and finance, e.g. 
tree-ring data series, wheat market prices (cf., e.g., Baillie |9j) and stock market and 
foreign exchange returns (cf., e.g.. Ding and Granger [IS])- The influence of past 
realisations may be defined in terms of the persistence of the autocorrelations of 
the series, with a stationary series whose autocorrelations decay at a non-summable 
rate being referred to as a "long memory" process. Furthermore, the presence and 
application of long memory processes in macroeconomics, asset pricing models and 
interest rate models is noted in [S] and the references contained therein. Various 
properties of fractional Brownian motion are illustrated in Mandelbrot and Van 
Ness |24| : of particular note is that increments of fractional Brownian motion are 
stationary, self-similar and can exhibit long memory. 

Kirman and Teyssiere |21[ [32] give discrete time series models which are derived 
from a market which is composed of fundamental and technical analysts, these 
models are then shown to possess long memory characteristics in the differenced 
log returns of price processes associated with these models, while other features 
such as bubbles are demonstrated. Appleby and Krol [7| analyse the long memory 
properties of a linear stochastic Volterra equation in both continuous and discrete 
time, with conditions for both subexponential rates of decay and arbitrarily slow 
decay rates in the autocovariance function being characterised in terms of the decay 
of the kernel of the Volterra equation. A continuous-time infinite history financial 
market model is discussed in Anh et al. [Illlj, which is a generalisation of the classic 
Black-Scholes model, where characterisations for long memory are proved. In each 
of [TJ[51[7] the equations studied have additive noise, so the size of stochastic shocks 
are independent of the state of the system. 
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A widely-employed class of discrete-time stochastic processes in which the shock 
size depends on the state are the so-called ARCH (autoregressive conditional het- 
eroskedastic) processes. ARCH processes are widely used and studied in financial 
mathematics to characterise time varying conditional volatility as well as the non- 
trivial autocovariance functions possessed by autoregressive processes driven by 
additive noise. In particular, the ARCH formulation captures well the tendency for 
clustering of volatility Engle [12] . Much of the work on ARCH processes concerns 
processes with finite memory: if only the last q values of the process determine the 
dynamics, the process is termed an ARCH(g) process. A property of these finite- 
memory processes is that their autocovariance functions decay exponentially fast 
in their time lag. Therefore slow decay or long memory in an ARCH-type process 
can only be achieved by considering terms from unboundedly far in the past. This 
naturally leads to the study of ARCH(c>o) processes and in this work we study the 
memory properties such processes. A standard definition given in e.g., .18j . for 
these processes is: 

Definition 1. A random sequence X = {X{k), fc G Z} is said to satisfy ARCH(oo) 
equations if there exists a sequence of independent and identically distributed (i.i.d.) 
non-negative random variables ^ = {^{k), fc G Z} such that 

oo 

(AH) X{k) = ^{k)ak), ,{k)^a + Y,b{j)X{k~j), 

where a > and b = {b{j),j £ {1,2, ...}} satisfies b{j) > 0, for j e {1,2, ...}. 

ARCH(oo) processes were initially introduced by Robinson |26. as an alternative 
model when testing for serial correlation. This process is a generalisation of the 
"classical" ARCH(oo) process 

CxD 

r{k) = <7{k)e{k), o{kf =T + Y. '^OX^ - j)'' 

i=i 

where r, > and e is an i.i.d. random sequence. Moreover (|AH[) includes models 
where r and a are replaced by an arbitrary fractional positive powers of themselves 
and the 'shocks', e, are taken to be non-negative. The terminology ARCH(oo) is 
justified, as an ARCH(oo) process is in some sense the limit of an ARCH((7) process 
as q ^ oo. It can be seen, moreover that ARCH(oo) processes are generalisations of 
the finite order ARCH and GARCH processes: indeed the ARCH(q) process of [TB] . 
results when 4>{j) = for j > g + 1 and the GARCH(p, q) process of Bollerslev [TT] 
may be rewritten as an ARCH(oo) process with exponentially decaying weights b. 

As attested to above, empirical findings indicate the presence of long memory in 
financial and economic time series, which has resulted in research being focused 
on the long memory properties of stationary solutions of ARCH-like processes 
(cf., e.g., Baillie et al. [TO])- Of note here are the investigations into necessary 
and sufficient conditions for the existence of a weakly stationary solution of the 
ARCH(oo) process, conducted by Giraitis, Kokoszka, Leipus, Surgailis, and Zaffa- 
roni [T8j [T9j [23j [31] . Moreover, these papers extensively study the autocovariance 
structure and long memory properties of (|AHp . Section[3]details some of the results 
of [IHl Uni [SI] which are applicable to the results of this article. Also in Section [3] 
we highlight in particular the importance of an underlying resolvent equation in 
determining the long term memory characteristics of (lAHp . Also, a Volterra series 
representation of the autocovariance function is established. 

The main results of this article appear in Section [Jj where conditions on the 
data of (|AH[) . i.e., a, &, ^, are given to describe decay rates in a class wider than the 
class of hyperbolically decaying sequences considered heretofore. Roughly speaking. 
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for the memory, or kernel b, lying in a class of slowing decaying (subexponential) 
sequences it is shown that the autocovariance function must decay at precisely the 
rate of b. Furthermore, we prove for the first time converse results which show that 
such exact non-exponential rates of decay of the autocovariance function result only 
when b lies in this class. These results strengthen the hypotheses of [211 Theorem 2]. 

Section [S] describes the effect that upper and lower slowly decaying bounds on b 
have on the autocovariance function. The main result is that a nontrivial subexpo- 
nential upper bound on the rate of decay of the autocovariance function is equiva- 
lent to a nontrivial subexponential upper bound on the decay rate of the kernel b. 
However, a numerical example demonstrates that a corresponding lower bound on 
the autocovariance function docs not necessarily come from a corresponding lower 
bound on b, so one cannot readily characterise necessary and sufficient conditions 
for lower bounds on the memory of (jAHl) . Section [5] also gives necessary and suf- 
ficient conditions for exponential decay of the autocovariance function. This last 
result complements the sufficient conditions of [231 Theorem 3.1] while employing 
a different method of proof. 

One of the chief differences in the analysis of this paper to that of [T51 (THl [23] 
is that rather than analysing an explicit representation of the solution of (jAHp . 
we primarily express the autocovariance function and its associated resolvent as 
the solutions of Volterra equations and then employ admissibility theory of linear 
Volterra operators to study the asymptotic behaviour. Such admissibility theory 
has been developed and used by Appleby, Gyori, Horvath, Reynolds [3J [SJ [SJ 
to determine rates of convergence to the equilibrium of linear Volterra summation 
equations. The proofs of results stated in Sections[l|and[S]are confined to Section[ni 

In this work, we have concentrated solely on the asymptotic behaviour of station- 
ary solutions of ARCH(oo) equations. It is our belief that many of the asymptotic 
results presented here are robust to mild departures from stationarity. However, an 
investigation of this conjecture is deferred to a later work. 

2. Preliminaries 

Let Z be the set of integers, Z+ — {n ^ Z : n > 0} and M the set of real 
numbers. If d is a positive integer, R'^ is the space of d-dimensional column vectors 
with real components and W^^'^ is the space of all d x d real matrices. We employ 
at various points the standard Landau order notation (cf e.g., [HJ Chapter 8.1]). 
Let / and g be two functions defined on Z or M. Then the notation f{n) ^ g{n) 
as n — cxD means that lim„_>oo = 1- Sequences u = {u{n)}n>o in M'' or 

U = {U{n)}n>o in M.'^^'^ are sometimes identified with functions u : Z+ — > R'^ and 
U : Z+ ^ M"^"^^. If {U{n)}n>o and {V{n)}n>o are sequences in W^""^, we define 
the convolution of {([/ * V){n)}n>Q by 

n 

=^f/(n-j)nj), n>0. 

3=0 

In this paper the Z -transform of a sequence U in M.'^^'^ is the function defined by 

oo 

j=o 

provided A is a complex number for which the series converges absolutely. A similar 
definition pertains for sequences with values in other spaces. We remark that this 
definition of the Z-transform differs from the more usual definition (see e.g. [I4l 
Chapter 6.1]) in that A plays the role of A~^ and hence roots and poles of the 
Z-transform which were outside the unit circle are now inside the unit circle, and 
vice versa. 
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For random variables U and V defined on tire same probability space, and which 
each have finite variance, we denote their means by E[J7] and E[y] and their vari- 
ances by Var[C/] and Var[y]. Their covariance is denoted by Cov{U, V). A stochastic 
process X — {X(k) : /c g Z} is said to be weakly stationary if it has constant mean, 
E[X(fc)] G R for all k <E Z, and there exists a function, called the autocovariance 
function, p = {p{k), fc G Z} such that, 

(2.1) p{k) = Cov[X{n),X{n + k)], for all n, fc G Z. 

Throughout this work the qualifiers weak and weakly are dropped, and we refer to 
such processes as being stationary or possessing the property of stationarity. The 
concept of stationarity is that a structure is imposed upon the statistical properties 
of the process which gives the process a time-invariance property. The autocorre- 
lation junction of X is defined by p(A:)/Var[X(0)] for k G 7^, where Var[X(0)] is 
non-trivial. 

It is of special interest in this work to establish the rate at which p{k) 
as fc oo and in particular to investigate whether the process X possesses long 
memory. A number of definitions of long memory exist in the literature: here we 
adopt one of the commonest, saying that X has long memory if the autocovariance 
function is not summable i.e., 

oo 

(2.2) ^|p(A;)|=+oo. 

The underpinning idea of long memory is that realisations far in the past do not 
fade away quickly and so have a bearing upon the present and future development 
of the process. The significance of long memory as a measure of the efficiency of a 
financial market is discussed in e.g. Cont |12) . 

3. Discussion of Existing Results on ARCH(oo) Processes 
Throughout this article we use the notation 

oo 

Ai=E[e(0)], X2=m0f], B^Y.^{]), a2=Var[e(0)] = A2-A?. 

It is assumed throughout that both the first moment of ^ is finite and non-zero, 
i.e. < Ai < oo. A zero mean of ^ results in X reducing to the trivial solution, 
i.e. X{k) = a.s. for all k € Z. Also ct = is equivalent to the shocks ^ being a.s. 
constant, and is therefore not of interest. Equally, the case a = is not of interest, 
for it is known in this case that X{k) = a.s. for ail k € Z is the only stationary 
solution of (|AHp . see e.g. [IHl Theorem 2.1]. 

Furthermore if b{j) = for all j > 1 then this results in the degenerate case of a 
constant conditional volatility of X in (jAHp , thereby defeating the initial motivation 
for studying ARCH processes. In this case, X degenerates to a constant multiple 
of the i.i.d. non-negative "shocks" . We thus argue it is reasonable to assume that 
there exists at least one value in the sequence b which is positive. For this reason, 
we have as a standing hypothesis throughout the paper that 

(50) AiG(0,oo), a>0, cr g(0,oo), 6^0. 
With the added assumption that 

(51) XiB < 1, 

it is shown in [18] that E[X{k)] = aAi/(l - XiB) < +oo for all fc G Z. 

A moving average representation of the solution of (|AH[) is derived in [15]. We 
briefiy outline the construction of this representation and use it to develop a Volterra 
equation satisfied by the coefficients of this representation. The results later in this 



ON RATES OF DECAY OF STATIONARY ARCH(oo) MODELS 



5 



work concur with |31[ Theorem 2], namely that these coefBcients determine the 
rate of decay of the autocovariance function. 

Let = 1 — Ai ^(j)-^"': where L is the lag or backward shift operator 

which operates on a process Y = {Y{k) : k £ Z} according to = Y{k — 1). 

Define iy{k) := X{k) — Ai^^(fc): then from (jAH[) we have 

^{L)X{k) ^a\i + v{k). 

A moving average representation for X is then obtained by applying the operator 
iIj~^{L) across this equation. The existence of such an inverse operator (on the 
closed unit circle in the complex plane) is given in and the references contained 
therein. This existence is chiefly guaranteed by the summability of 6, a consequence 
of dSil ) which is assumed throughout this work. We now state Lemma 4.1 of [TB], 
which is also Problem 8, Chapter 18]. 

Lemma 1. Suppose Xl^olV'jl < V-'('^) J2^o^-'i^'' ' ^"'^ IV-'('^)I > for 
\X\ < 1. Then there exists a sequence z ~ {z{j) : j G Z+} such that D{X) := 
l/'iJj{X) = J^jLo ^iJ)'^'' '"'e/Z defined for all \X\ < 1. Furthermore, J^'jLo < 

+CO. 

We state the theorem guaranteeing a moving average representation from [181 
Theorem 4.1]. 

Theorem 1. // condition ( |Si[ ) holds, then there is a solution X of (|AHp which 
admits the representation 

oo 

X{k)=E[X{k)]+Y,z{jMk-j) 

j=o 

where X^jlLo 1-^0)1 ^ °° '^"■'^ process v satisfies M[h'(k)\J-'{k — 1)] = for each k, 
where {J-{k))ki£z is the natural filtration generated by ^. 

Moreover, in 118' it is shown that with the additional assumption 

oo 

(3.1) A|5]5(i)<l, 

then (jAH[) has a unique weakly stationary solution, and hence E,[v(k)'^] < +oo. 

In both [IH] and |3T] necessary and sufficient conditions are derived for the ex- 
istence of a weakly stationary solution of (jAH|) . For completeness we state next a 
slightly reformulated variant of part of [191 Theorem 3.1], omitting those parts that 
are not relevant to our investigation. 

Theorem 2. The following are equivalent 
(a) JSil ) holds and 



1/2 



(S2) 




where z is (well) defined by 
1 



= Y.z{j)X\ |A|<1; 



(b) A weakly stationary solution X of (jAH[) exists. 
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Both imply that there exists a unique, ergodic solution of (|AHp which may be written 
as a convergent orthogonal Volterra series. Moreover, Cov[X {Q) , X {k)] > and 



(3.2) Cov[X{0),X{k)]^ l^j-j-^j ——^^(^k), for fc e Z, 
where 

oo 

(3.3) x.(fc) = E^(j>(j + l^l)- 

3=0 

While the exphcit representation of X as a convergent orthogonal Volterra series 
is a key component in the proof of Theorem [21 in order to keep this article concise 
we do not state this explicit form in the above as it does not form part of our 
analysis. We further comment that, as observed in [19], the condition ( [S2I ) is weaker 
than (|3.1|) . which is imposed in [IJ]. Under ( IS2D , X is weakly stationary and the 
autocovariance function is a multiple of Xz and hence is absolutely summable, thus 
ruling out long memory. Moreover as 6 > by hypothesis, this gives, via (j3.6p . 
that 2; > and hence, under the condition ( [S2I ), Theorem [2] gives Cov[X (n) , X {n + 
k)] > 0. This observation concurs with that of [18^ for the non-negativity of the 
autocovariance function under (13. ip . 

Under the conditions of Theorem [5J the moving average representation of The- 
orem [T] and p.2p imply that 



E[i/(0)2 



1 



and also that 



,3.4) Va,[X(0)l= ^ T^S*)' 



l-XiBj 1-1^2' 

" 1 + xinya^ 



\-\iB 1 - f72 ^ V 1 - AiB / 1-^2 

The first result of this paper is the calculation of a Yule- Walker style of represen- 
tation for the autocovariance of (jAHp . 

Proposition 1. Let ( |SiP and ( [S2I ) hold. Then p, as defined by (|2.1I) . obeys 

{ Ai E ,tloo Hk - jXj), k e {1, 2, 3, ...}, 

(3.5) Pik) =L{0), ifk^O, 

[pi-k), ^fke {-1,-2,-3,...}, 



where p{0) is given by (13.41) . 

The proof of Proposition [1] in common with many of the main results of the 
paper, is postponed to the end. 

Proposition [1] shows that the autocovariance obeys a Volterra summation equa- 
tion with infinite delay. Since the chief focus of this paper is to describe the asymp- 
totic behaviour of p, it is interesting to draw a distinction between the potential 
asymptotic behaviour of p and the asymptotic behaviour of the autocovariance func- 
tion of an equation with a finite number of lags. To this end consider an ARCH(g) 
rather than an ARCH(oo) process. Then the resulting autocorrelation function, as 
described by e.g., Taylor [29l pp. 77, 95], corresponds exactly to the autocorrelation 
function of the AR((7) process 

W^(fc)=^Aife(j)W^(fc-j)+e(fc), fceZ, 
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where e = {e{k)}kei. is an uncorrelated sequence of random variables with finite 
constant variance. Hence p.Sp reduces to the Yule-Walker equations: 

q 

p(fc) = Ai^60>(fc-j), fee {1,2,...}. 

Thus, the autocovariance function satisfies a g*''-order linear difference equation 
with constant coefficients. It is well-known that if the ARCH process is to be weakly 
stationary, all solutions of an auxiliary polynomial equation must lie inside the unit 
disc in C, and that this condition also forces the autocovariance function to decay 
geometrically. Hence, for a finite history equation with a stationary solution, the 
autocovariance function must decay geometrically: polynomial decay is impossible. 

Thus, the study of the autocovariance function of AR or ARCH models is bound- 
up with that of difference equations. It is then natural to ask what the asymptotic 
features of the solutions of unbounded equations of the form 

yik) ^^■u{k-i)y{i), fc > 1, 
j=o 

are for some m : Z ^> R and initial condition y{0) and whether such an equation 
could be regarded as an underlying equation for the autocovariance function of some 
stationary times series. To the former question: it is well known that the dynamics 
of this equation allow both exponential and slower-than-exponential decay (see 
e.g., [3S] for convergence rates in weighted spaces, [S] for exact rates in spaces, 
and [TS] for the characterisation of exponential decay). As to the latter: while for 
a stationary time series this is an open question nevertheless for a non-stationary 
times series such an equation could describe a family of autocovariances indexed 
by an initial starting time m £ Z i.e. k i-> Cov[X {m) , X (k)] — ym{k). 

The distinction between this work and [HI [1^1 [231 [31] is that we exploit the fact 
that z from Lemma [T] and Theorem [5| may be written as the solution of a Volterra 
summation equation. 

Lemma 2. Suppose, for any R > 0, Xi J2'jLi ^(j)^"* < +oo and i^{X) = 1 — 
Ai X^j^i ^U)^'' f^'"' \M — Then the following are equivalent: 

(i) D{\) := l/V^A) = Ejto defined for |A| < R, E^to < 
oo and 

n-l 

(3.6) z(n) = Ai^6(n-j>(j), n-l, 2,...; z(0) = 1; 

j=o 

(ii) AiE,°1iKj-)^^ <1- 

Remark 1 . We remark that in the case R = 1 much of the above lemma is covered 
in Lemma [TJ We note however that in Lemma [2] the necessity of the condition 
Ai J2'jLi b{j)R-' < 1 for the summability of z is drawn out. 

Remark 2. It is elementary, using p.6|) . to show that p.2p is a solution of (13.51) . 

We observe that z may be thought of as a resolvent for (j3.5p where the summation 
term is broken into a sum up to time fc — 1 and the remainder of the sum thought 
of as a perturbation term, i.e. 

fc-i 

(3.7) p(A)^Ai^6(fc-j>(j)+/(fc-l), fc>l, 
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where /(fc) — \\ ^Y^=\ + i + l)p(^j) ^-nd hence one has the variation of param- 
eters formula 

fe-i 

(3.8) p(fc) = z(fc)p(0) + ^z(fc-j-l)/(j), k>l, 

j=o 

(see e.g., [15 )■ We demonstrate the usefulness of this formulation of the autocovari- 
ance function in the proof of Theorem [T31 As this paper primarily uses properties 
of Volterra equations to derive its results, it is perhaps more intuitive to regard z 
as the solution of an associated resolvent equation rather than the coefBcients of a 
power series or moving average representation as in |18l 1191 131) . 



Remark 3. Using (|3.6p and p.l|) . we can show that ( [S2I ) holds. Recalling that (|3.ip 
implies ( |SiD , we can thus independently verify the sufficiency of (13.11) for the weak 
stationarity of the solution of (jAHp as shown in 18, Theorem 2.1]. 

Proof of Remark\^ Applying the Cauchy-Schwartz inequality to the righthand 
side of (|3.6p yields 



z(n)2<A?S^5(n~j>(jf , n>l. 
j=o 

By summing both sides of this equation, and using the fact that p.ip implies that 
is summable, we obtain 

GO 00 TL — 1 00 

1 + E < 1 + A?i? E 5: 6(n - j)z{jr = 1 + X\B^ ^(^■)'- 

n—l n—1 j—Q J—0 

Since z{0) — 1, we obtain J^JLi ^^U) < 1/(1 ^ A^i?^) — 1. Using this bound and 
(EH) leads to □ 

Remark 4. We can use the fact that z satisfies p.6p to obtain a condition on 
b which implies the stationarity of X and which is sometimes weaker than the 
condition p.ip . More precisely, we show that 

(3.9) X,<Xl + |o^^ 

implies ([S2I), and that (13. ip implies p.9p if 



(3.10) XiB < 



Proof of Remark [7) We start by noticing that QSiP implies z is summable, and 
by summing on both sides of p.6p it can readily be shown that X]j=o '^(■^) ~ 
1/(1 — XiB). Since b and z are non-negative, we may apply the Cauchy-Schwartz 
inequality to the right-hand side of p.6p to get 

n— 1 n—l 

Since 2^ is summable, we get 

00 00 00 TL — 1 00 

E < A? E -0) • E E - - ^^ n-lm^ E ^O')'- 

n=l j"=0 ri=l j=0 ^ ' j=l 
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Therefore by this estimate and p.9p . we have 

which is ([S^l- We notice that p.ip can be written as \2B^ < 1, so p.ip is stronger 
than dSll) if 

which is equivalent to p.lOp . because Aii? < 1. □ 

4. Exact Rates of Decay of the Autocovariance Function in the 

Class W(r) 

4.1. Subexponential decay in linear Volterra summation equations. In 

ascertaining rates of decay of Volterra equations we use admissibility theory of 
Volterra operators, see e.g. [5]. [4] illustrates this facet of admissibility theory for 
a discrete time Volterra equation whose solution is an autocovariance function. 
We mention some pertinent results of this theory. Consider the linear convolution 
equation 

n 

(4.1) x{7i + l) = f{n) + ^F{n-i)x{i), n > 0; a;(0) = a-Q £ M, 

where / : Z+ — > K. and F : Z+ — > M. This problem has a unique solution x : Z+ — !> 
M. In the case that x{n) — > as n — > oo, our aim is to describe the exact rate of 
decay of x. Our method is to introduce a suitable sequence 7 = {'~t{n)}n>o which 
decays to zero and then to examine the behaviour of 

(4.2) uj{n)^x{n)h{n), 

and show that uj converges to a non-trivial limit. It then follows that x{n) — > as 
n 00 at exactly the same rate as ^{n) — )■ 0. 

We define a suitable class of real-valued weight functions, which was studied in 

0. 

Definition 2. Let r > be finite. A real-valued sequence 7 = {7("')}n>o is in 
W{r) if 7(n) > for ah n > 0, and 

(4.3) Jim ' = -, ^7(z)r-* < 00, 



7(n) r' 



i=0 



(4.4) 



/ 1 \ 



Observe that if r < 1 and 7 G VV(r), then 7 decays; whereas if r > 1, 7 diverges. 
If 7 is in W(l), it is called a subexponential sequence, one reason being that if 7 is 
in W(l), then 

(4.5) lim ^{n)K^ = 00 for all k > 1. 

n— f 00 

The terminology is analogous with subexponential functions and distributions. Of 
course if 7 is in >V(r) and d{n) = r~"'j{n), then S is in yV(l). 

Examples of sequences in W{r) include, but are not limited to, j(n) = r^n~" 
for a > 1; 7(71) = r"/!"" exp(-n^) for a € R, < /3 < 1; and 7(71) = r"e-"/(^°s"'. 
The sequences defined by ^{n) = r", and 7(n) = r^n~°' , a <1 are not in W(r). 

We divide the results of this section into a discussion of subexponential rates of 
decay [r — 1) and a discussion of >V(r) rates of decay for r < 1. While the proofs 
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of both of these sections are treated together, we choose to present the results 
separately in order to emphasise the subexponential behaviour in (|4.3p which falls 
just short of long memory and which is perhaps of greater interest in the context 
of time series. The principal difference in the statement of these decay results is 
that for sequences which are in W(l) we further require that they are asymptotic 
to non-increasing sequences, whereas a sequence in the class W(r), for r < 1, is 
asymptotic to a non-increasing sequence by the first part of (|4.3p . Hence we define 
a subclass yV^{r) of W{r) for r e (0, 1] by 

W^{r) {g :Z+ ^ (0, oo) : g e W{r) and there exists 7 : Z+ ^ (0, 00) 

such that 7(n + 1) < 'j{n) for all n G and g{n) ^ j{n) a.s n ^ 00}. 

We note that W^{r) = W(r) for r < 1. This additional monotonicity is in practice 
quite a mild assumption given that we are interested in determining a rate of decay 
of p. We require it to simplify the asymptotic analysis of certain infinite sums. 

If 7 is a real sequence with 7(n) > for all n > and {w(n)}„>o is a sequence 
in such that lim„_i>oo u(?i)/7(?i) exists, then this limit is denoted by L^u. 

This notation enables us to state succinctly [5{ Theorem 3.2]. 

Theorem 3. Suppose that there is a j in W(r) such that L^f and L^F both exist, 
and that 

00 

(4.6) ^r-(*+i)|^^(i)| < 1. 

i=0 

Then the solution x 0/ (j4.ip satisfies 

/ 00 \ —1 00 

(4.7) L^x- r-^r-*F(z)) [L^/ + (L^i^) J] r^Mj)], 

^ 1=0 ^ j=0 

where 

00 / 00 \ —1 00 

(4.8) ^r-^x(j)= (r-^r-^-^^(fc)) [rx^ +Y,r-' f{l)]. 

j=0 ^ fc=0 ^ i=0 

4.2. Necessary and sufficient conditions for subexponential decay. Our 

first main results show that subexponential decay in b implies subexponential decay 
in p, and moreover that p decays at exactly the same rate as b. 

Theorem 4. Let Q and XiJ2T=i^(3) < ^ e W^(I) then p e W^(I). 

Moreover, 

(4.9) L,p^ ^(J)- 



3 ■ 



The proof of Theorem [4] is a consequence of Theorems [2] and [3] This result 
is strongly related to (31. Theorem 2], about which we comment presently. The 
limit on the righthand side of (14. 9p is zero only when aa ~ which is ruled out 
under the standing assumptions ( |SoD discussed at the beginning of Section [31 The 
limit formulae (j4.9p highlights the inherent short memory of stationary solutions of 
ARCH(c») equations, because the infinite sum can be expressed in terms of a finite 
quantity. 

A simple corollary of this result is that if b obeys b{k)/k^°' ^•c>Oasfc^>oo 
for some a > 1, and ([S2]) and Ai Yl^=i HJ) < 1 ^-Iso hold, then b G VV^{1), and we 
have 

hm ^ = c'>0. 
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We notice that this strengthens shghtly results in [TB] and [12], which give upper 
and lower polynomial bounds on the rate of decay. 

The necessity of subexponential decay in b is captured by the following result, 
which to the best of the authors' knowledge, is not analogous to known results in 
the time series literature. It shows, under an additional stability condition to that 
in Theorem 21 that if p is decaying subexponentially, then b must decay subexpo- 
nentially, and at the same rate. 

Theorem 5. Let ^ and Ai J^T^i ^0) < ^/^ ^old. Then b e W^{1) if and only 
if p & W^{1), and both statements imply (|4.9p . 

In the same spirit, we establish later in the paper a corresponding pair of results 
for sequences in W(r), as well as necessary and sufficient conditions for p to be 
bounded above by a subexponential sequence. 

A novel feature of the proof of Theorem [5] is that we deal with the advanced 
difference equation p.2p , rather than a Volterra equation. The proof of this partial 
converse is more delicate than that of Theorem |4] itself. It relies mainly on showing 
that p is asymptotic to z; once this is done, a known result from the theory of 
Volterra difference equations ensures that z is asymptotic to b. 

4.3. Connections of Theorem |4]vifith extant vifork. Theorem|4](and Lemma[3]) 
assert that, when 6 is subexponential, then both p (and z) inherit the rate of decay 
of b. A result in almost exactly this direction is proven in [3TJ Theorem 2]. There, 
it is claimed that if ( |Si[ ) holds (which forces b to be summable) and 

b(k) 

(4.10) lim = oo, for any < ( < 1, 

fc— >oo 

then 

(4.11) z{k) - Ci6(fc) and Xz{k) - C26(fc), as fc oo, 

where Ci, C2 S (0, 00) and Xz is as defined in p.3p . The first asymptotic estimate 
appears as part of the proof of [3TJ Theorem 2] , but the statement of the theorem 
lists only the second estimate as its conclusion. 

It should be noted that when b E W(l), it obeys the first condition in (|4.3[) 
(with, by definition, r — 1), and therefore obeys (|4.5p which is equivalent to (|4.10p . 
Therefore, at a first glance, it would appear that Theorem 2] proves the same result 
as in [211 Theorem 2], but requires stronger hypotheses, as yV(l) is merely a subclass 
of the summable sequences obeying (j4.10p . 

Despite this, we now show that there exist sequences b which obey (I4.10p . and 
which also satisfy the other conditions of [31] Theorem 2] , but for which the claimed 
asymptotic behaviour for z and Xz in (|4.11l) does not hold. Notably, the sequences 
we consider are ruled out under the stronger conditions of Theorem U above. In 
essence, we show that if b does not obey the first condition in (j4.3p due to the 
presence of a 2-periodic component in its decay, then this 2-periodic component 
is present in the rates of decay of z and of Xz- Furthermore, this decay is "out of 
phase" , in the sense that neither z nor Xz are asymptotic to b, and therefore violate 

The example we cite has been explored in detail in [3] (see Examples 4.2 and 
4.5 and Remarks 4.4 and 4.6 in [3]). However, to make our presentation self- 
contained, we restate the main details of these results and comments here and 
examine a specific numerical example. Scrutinising the presentation in [3], it can 
be seen that the example can be generalised to cover any rate of decay in W(l). 

Example 1. Let b{n) = ain^^ for n/2 G N and b{n) ~ oqu^'^ for n/2 ^ N where 
flo = 0.5 and oi = 0.25. Also, let {'^(n)}„gN be a sequence of independent and 
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identically distributed non-negative random variables with mean Ai = 1. Note 
that 

,. &(2n + l) ^ &(2n + 2) 1 

lim — - — = 2, lim — = -, 

n-s-oo 6(2n) «-^oo6(2n + l) 2 

so that h docs not obey the first part of (|4.3p for r = 1 (or indeed any value of r), 

but does obey (|4.10p . Since ( |Si[ ) holds, |3lJ Theorem 2] predicts that there exist 

Ci, C2 G (0, cx)) such that 

1™ ITT = "^i' 1™ ^ = C2, 

n->oo t)(^rij n-i-oo bin) 

while Theorem m does not apply. 

However, by applying ^ Theorem 3.2], to this example and setting (t>{n) = rt^^ 
for n > 1 and 0(0) = 2, explicit calculations in ^ Example 4.2, 4.3] demonstrate 
that we have b{2n + i + l)/0(2n) > for i G {0, 1} and (/) G W(l) with 

ao ^ oi, and 

z{2n) , , ^(2n+l) 

do hm = aoTo + aiTi, rfi := lim — . = aiTo + aoTi, 

n— s-oo (pi^Zn) n— s-oo (pyZn) 

where Tq = A(2S'o(l - S'l)), Ti = A(S'g + (1 - Sif), A = ((1 - 5-1)2 - S^)''^ and 
'S'j = Ai X]^o ^(^.^ + i + 1). In this specific example, it can be shown that 
""1 2 °° 1 2 

1 TT^ „ x-^ 1 TT^ 



^o-«oE(27 + l)2 - 16' ^i-«iE- 



(2j + l)2 16' ' '^22(j + l)2 96' 

and noting that Sq + Si < 1, one can evaluate A, Tq and Ti respectively and hence 
do and di. Indeed A = 5.55073..., To = 6.14391... and Ti = 6.58015..., which gives 
do = 4.71699... and di = 4.82605.... Therefore 

n— >-oo (pyZn) n— !-oo o[Zn) 
n^(X3 0(2rj + 1) n^oc6(2n+l) 

and Ado 2rfi. Hence the claim of the first statement of (|4.1ip does not hold. 

Consulting [5J Example 4.5 and Remark 4.6] shows that, under the above con- 
ditions, we have 



1™ ~r7^77V ^ "o'^o + am, hm — — — — = aon + uiTq, 

fe— >oo (P[Zk) fc-i-oo (p[ZK) 



where 



TO = To ^ zi2j) + Ti ^ z{2j + 1), Ti=TiJ2 ^i^j) + + !)■ 

J=0 J=0 j=0 j=0 

Thus for Xz ^ b we need limfe^oo Xz{2k)/b{2k) = limfc^oo Xzi^k + l)/b{2k + 1), 
which is equivalent to To(ao — ai)(ao + ai)/(aoai) — 0, which can only occur if 
To = 0. To rule this out, note that summing over p.6p for both z{2n) and z{2n + 1) 
gives 



§ '^^'^ " (1 - ^1)^ - ^0^ ' 2 + " (1 - ^1)^ - ^0^ ' 



Filling in the values of ^o, ^i, Tq and Ti enables us to compute tq = 22.5498... 7^ 0. 
Hence the limits are unequal. In fact, we have 

Xzi.2k) ao R7 0'57P; r Xz{2k + I) ai 0.1 ioq 

1™ TTKTT' ~'^o + Ti = 67.9375 . . . , hm = — tq + ti = 34.1128 . . . 

fc->oo b(ZK) fli k^oo b[ZK + I) ao 

This contradicts the second statement in (14. lip . 
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4.4. Necessary and sufficient conditions for W(r) decay. If it is observed 
that the autocovariances of the ARCH(oo) equations decay in a manner consistent 
with the class W{r) for r G (0, 1), then this can only occur if the memory of the 
process, b, decays likewise. 

Theorem 6. Fix r e (0, 1). Let §^ and Ai J2T=i Kj)r'^ < 1 hold. If b e W(r) 
thenpCzW{r). Moreover, 

,. pjn) ^ mon Ai 

^' ' ™ b{n) (1 - Ai E,°:o bUVn ■ (1 - Ai E,^i Kj>-^T ' 

A converse corresponding to Theorem [S] may also be stated. 

Theorem 7. Fix r G (0,1). Let ^ and Ai < 1/2 hold. Then 

b G W(r) if and only if p e W(r) and both imply (I4.12p . 

We remark that the rate of decay exhibited by a function in the weight class 
of functions yV(r), for r < 1, is faster than a purely geometric rate of decay. 
Let b G W(r), for r < 1, and suppose that the conditions of Theorem [S] hold. 
Consider the open disc £> = {A G C : |A| < 1/r} of radius 1/r in the complex 
plane. Then the Z-transform of b is defined on D and on the boundary of D, 
az? = {A G C : |A| = 1/r}. Thus ip, of Lemma is well defined on D ^ DUdD. 
However, by the conditions of TheoremlHl ip has no zeroes in D. Moreover, because 
b is in W(r), and b{j) > 0, we have X^jli + = +0° fo^' every e > 0, 

and therefore neither the Z-transform of b, nor V', are defined for real A > 1/r. 
Therefore the characteristic equation V'(A) — excludes the possibility that there 
are geometrically bounded solutions of z at any rate (1/|A|)" for |A| < 1/r. On the 
other hand. Theorem [S] ensures that z decays at the rate r" times a subexponential 
sequence. 

and the Z-transform of b may be well defined in other regions of the com- 
plex plane in the complement of D, and indeed ip may have zeroes in these other 
regions. Irrespective of these potential zeroes, it is the W(r) rate of decay of b 
which determines the asymptotic behaviour of the resolvent z (i.e., the VV(r) rate 
of decay dominates the geometrically decaying solutions associated with the zeroes 
of ip). This analysis is consistent with Theorem 1131 which describes a geometric 
decay. However, in light of the above comments, it is apparent that this geometric 
decay rate need not be given in terms of the roots of the characteristic equation. 

5. Bounds on the Decay Rate of the Autocovariance Function 

In this section we show that if there are decaying bounds imposed upon the 
kernel of (j3.5p then this forces the autocovariance function to also be bounded with 
the same bounding decay rates. While the thrust of SectionUwas that specific rates 
of decay of the kernel imply those same rates of decay arising in the autocovariance 
function, we present an explicit example where a bound in the rate of decay present 
in the autocovariance function does not arise from the same rate of decay in the 
kernel. 

Many of the results of this section hinge on the positivity of either b or p rather 
than merely on non-negativity. Following on from the standing assumptions ( |SnD 
at the start of Section[21 we may assume that b has at least one positive component. 
Therefore, we are free to assume that 

(Ai) There exists a minimal 1 < j* < oo such that b{j*) > 0. 

Then assuming ( |AiP , 

i*-i 

4r) = Ai ^ bif - 0^(0 > Ai&(j*) > 

1=0 
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and 

oo 

pif) = EHof] J2 m-Ai + .f) > mofMr) > o. 

By (|3.5p . for /c > we sec that 

fc 

p(fc + l) = Ai J2 Kk + l-l)p{l)>Mb{k + l+J*)p{-j*), 

1 — — 00 

so 

(5.1) p(fc+i) > Ai6(fc+i+r)p(r). 

Similarly, for all k > j* , z{k) > Xib{k - j*)z{j*). 

Theorem 8. Let r e (0, 1] and suppose that Ai J^JLi b{j)r^^ < 1 and ([S^]) hold. 
Let 7 e yV-'-(r) be such that b{n) < 7(71) for all n > 0. Then 

(5.2) There exists C2 G (0, 00) such that p{n) < C2^{n), for all n>0. 

Remark 5. It is to be observed that Theorem[S]is concerned in part with bounds in 
the class of non-increasing functions in W(l), which is a wider class than the class 
of summable hyperbolically decaying functions examined in }18l Proposition 3.2] 
and [IS Corollary 3.2]. 

We now show that the conditions of Theorem [5] are sharp if we are to observe an 
upper bound on p in W"^(r). Then we mention a result concerning lower bounds 
on the autocovariance function. 

Theorem 9. Suppose that ( |SiD and ( IS2D hold and suppose that 7 € VV"^(r) for 
r G (0, 1]. Then the following are equivalent 

(a) Ai ^(i)'' < 1 '^^^ there exists Cq G (0, 00) such that 

b{n) < Co7(n.) for all n > 1; 

(b) There exists C2 G (0, co) such that 

p{n) < C'2j{n) for all n > 0. 

Theorem [5] asserts that (a) implies (b) . In the proof that (b) implies (a) the 
resulting bound on b is immediate from (j5.ip . while Ai 6(j)r~'' < 1 must 

hold, as z < Ci7, and so z{r^^) < 00. Therefore the proof of Theorem [S] is 
omitted. 

Theorem 10. Suppose that ( |SiD and ( IS2D hold and suppose that 7 G W^lr) for 
r G (0, 1]. // there exists Cq G (0, 00) such that b{n) > Co"f{n) for all n > 1 then 
there exists C2 G (0, 00) such that p{n) > C2"f{n) for all n > 0. 

The proof of Theorem (TU] is similarly omitted as it is immediate from (|5.ip . 
Combining the last two results gives the main result of this section. 

Theorem 11. Suppose that dSiP and ([S2]) hold and suppose that 7 G W^lr) for 
r G (0, 1]. Then the following are equivalent 

(a) Ai '^'jLi < 1 O'Ti'd there exists Cq G (0, 00) such that 

hm sup — -— = Cq ; 

n-!-oo 7(n) 

(b) There exists G (0,oo) such that 

r pin) , 

lim sup —— — Cn . 

n^oo 7(n) 



ON RATES OF DECAY OF STATIONARY ARCH(oo) MODELS 



15 



Remark 6. Theorem [TT] allows subsequences of b to decay at rates faster than 
subexponentially, or indeed to be equal to zero. In this respect Theorem [TT] is 
different from the related result Theorem |4l Indeed the nature of the decay of b 
may be quite erratic, yet providing that there is a subexponential decay which is 
an upper limiting bound for some subsequence of b then this limiting upper bound 
must be found in the autocovariance function and conversely. 

Remark 7. It is interesting to investigate what Theorem [11] claims in the case when 
r = 1. Suppose that there is a stationary solution X of (|AII[) . Then Theorem [5] 
shows that conditions ( jSij ) and ( [S2] ) hold. If, from observation of the time series 
data, a subexponential sequence 7 is proposed for which limsup„_^Q^ p{n)/^{n) S 
(0,00), then Theorem 1111 shows that limsup„_j.QQ b{n)/^{n) G (0, 00). 

Remark 8. It is interesting to ask whether an analogue of Theorem[TT]can be proven 
with the limit inferior in place of the limit superior, for even though it is obvious 
from (jS.ip that liminf„_i.oo 6(n)/7(n) > implies liminf„_i.oo /o(?t.)/7(?t.) > 0, it 
is not so obvious whether in general the converse holds. In Example [2] below, 
we demonstrate via a counterexample that this converse does not hold in general. 
Therefore, it is also the case that the converse of Theorem [TU] is not generally true. 

Example 2. Define the kernel b so that it exhibits some periodicity: 

Co, n/3 G Z+, 



b{n) 



otherwise. 



Note that X^jli ^0) ~ 47r^/27. Suppose that the sequence of shocks ^ = {C('T-)}nez 
is such that < Ai < 27/(47r^), so that ( [Si] ) holds. Following the techniques of [T] 
and the examples contained therein, we obtain 



where 



and 



z{ti\ 

liminf — — = K mi]i{do, c^i, (^2} > 0, 

n— >oo ft ^ 



= Ai^6(3n + i + l), {0,1,2}, 

n=0 



K = Ai/(1 - Si - 35o5i - S\f, 

do - 5^ + 2^1 (1 - Si) + 25o(l - Si) + 3(5'^ + Sf) + S\, 

di = 1 + 25^(1 - 5i) + 25i + 2Sl + 5^ + 35o'(l + Sl), 

d2 = 1 + 2^3(1 - 5o) + 25o + 2Sl -^Sl + iSl^X + Sl). 

Note that the denominator of K is non-zero if 5o > 0, 5*1 > and S'o + 5*1 < 1. 
Similarly one may show that 

r ■ f ^^(") • r 1 ^ n 

limmt — -yr- = min|co, ci, C2I > 0, 

n— ^00 fi ^ 

where is defined by p.3p and 

CO 00 00 

Co = do ^ z(3j) + di ^ z(3j + 1) + d2 ^ z(3j + 2), 

j=0 i=0 i=0 

00 CXD 00 

Cl = di ^ z(3j) + d2 ^ z(3j + 1) + do ^ z(3j + 2), 

00 CXD 00 

C2 = d2 ^ z(3j) + do ^ ^(3j + 1) + di ^ z(3j + 2). 

J=0 J=0 j=0 
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Noticing that J^TLi ^{iY — 87r^/729, we see from Remarks [3] and S] that if 




then ( |S2[ ) also holds and one has \m\\ain^oc, p{n) / n~ > 0. Therefore when the 
autocovariances of an ARCH(oo) process are observed to be bounded from below 
by a certain rate of decay, then it need not follow that this lower bounding rate of 
decay is present in b. 

This example illustrates two further general points made earlier: first, in this 
example limsup„_^Q^ b{n)/n^'^ G (0, oo), and the above results confirm that 

limsupp(n)/n^^ = E[t^(0)'^] max{co, Ci, C2} G (0, cxd), 

as claimed in Theorem II II 

Secondly, we notice from (I3.10p that whenever Ai < 9/(47r^), the condition (j3.9p . 
which implies the stationarity of X, is weaker than condition (|3.ip . 



Using the subexponential bounds of Theorems [S] and [TUl we can weaken the 
hypothesis that b is subexponential, but still recover results on polynomial and 
"superpolynomial" decay of p. This is achieved at the expense of some lost sharp- 
ness in characterising the asymptotic behaviour of p. 

Theorem 12. Let ([57]) and Q hold and (3 e {(l,oo) U {00}}. 
(i) // iin,i^ = -/3 then lim = 

n^oo log n r!->oo log n 

f\ V log&W r, logp(n) 

(11) limsup — —p ij and only ij limsup — —p. 

n->oo logn ,1^00 logn 

Once again, we notice that the equivalence of the existence of a stationary so- 
lution of (jAH|) and the conditions ( [Si] ) and ( IS2D means that the "polynomial-like" 
decay in the autocovariance function exhibited in Theorem [T2] is possible if and 
only if similar "polynomial-like" decay is present in b. 

Theorem [T^ can be used to determine the asymptotic behaviour for kernels b 
which are not covered by previous results. We can find examples of kernels b for 
which 

limi^ = -/3, b^Wil) 
n—Kx log n 

and also b for which 

limsup ^^"-^ ~I3, lim ^^^^ does not exist, b >V(1). 

n_j.oo logn n-^cx) log n 

An example of the former is b{n) = (2 -f cos(n7r))n^'^ or b{n) = log(n -I- 2)(2 -|- 
sin(n-|-2)) while an example of the latter is b{n) — j^-/3+sm(n)-i ^^j. ri> 1. All these 
examples are not subexponential sequences as they fail to satisfy the first condition 
of B31) . 

Remark 9. Example [H shows that the first implication in Theorem [T^ cannot be 
reversed, as lim„_i.oo log p{n) / log n = —2, but lim„_>oo log b{n) / log n does not exist. 

Remark 10. Theorem 1 1 1 1 can be applied when b{n) = (2-h (-l)")n-i(log(n + 2))-2 
with e.g., 7(n) = (n + 2)^^(log(n -I- 2))~^ G W(l), by following an adaption of the 
proof of [8, Proposition 3.3]. However, Theorem [T^ does not apply to this sequence. 
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Despite the last remark, one may prefer Theorem [T^ over Theorem [TT] if the goal 
is to fit real-world data to an ARCH(oo) model. In practice, one may not be able to 
establish a subexponential sequence to which the data is "close" . In particular, it 
may only be possible to identify the exponent of polynomial decay (— /3 S {—oo, — 1) 
in Theorem II 2p in b and not any lower order component (for example logarithmic 
or other more slowly varying factors). Such difficulties might render impossible the 
detection of the precise form of the subexponential sequence to which the kernel is 
close, particularly for sequences such as b{n) — 7^-/3+sm(n)-i^ 

In the final result, we show that exponential decay of b is both necessary and 
sufficient for exponential decay of p. Thus we recover a special case of (131 Theo- 
rem 3.1], which concerns exponential decay of the autocovariance function, while 
using a different method of proof. 

Theorem 13. Let ( |SiD and ([STJ hold. Then the following are equivalent: 

(a) There exist ai G (0, 1), Ci G (0, oo) such that b{k) < Cia\ for all k G Z+; 

(b) There exist a2 G (0, 1), C2 G (0, 00) such that p{k) < C2Q;f for all k G Z+. 

6. Proofs 

Proposition [1] necessitates that interchange of an infinite summation and an 
expectation sign. This interchange is made rigorous via standard application of the 
Monotone-Convergence Theorem (cf. e.g., 30, Theorem 5.3]). 

Proof of Proposition]^ Firstly observe that the identity p{k) = p{—k), for all fc G Z 
holds for the autocovariance function. Now, for fc > we have 

00 

p{-k) = Cov[X{n),X{n - fc)] = Cov[a£_{n) + ^ b{j)X{n - j)^{n),X{n - fc)] 

i=i 

00 

= a Cov[C(n), X{n ~k)]+Y^ b{j)Cov[X{n - j)^{n), X{n - fc)] 

00 00 

= + Ai ^ b{j)Cov[X{n - j), X{n - fc)] = Ai ^ b{j)p{k ~ 3). 

The result follows due to the symmetry of the autocovariance function. □ 

Proof of Lemma\^ Firstly we note that Ai X^jli ^(j)^"' < +0° ensures that 
is finite in the region |A] < R. 

Suppose now that Ai Xl^i ^(j)-^"' < 1- Let |A| < R. Define A A/i?, so that 
|A| < 1. Also, define the sequence ifi* by V'o = 1' V'j = -Ai6(j)i?^ for j > 1. 
Therefore J2jLo l^i I +oo- Consequently, we may define i^*{A) = X^jlo '^j^'' 
|A| < 1. Furthermore, for |A| < 1, we may use the non-negativity of b to get 

00 00 
IV* (A) I = |1 - Ai^&(j)^-'A^| > 1 - XiY.b{j)W > 0. 
i=i j=i 
Hence we may apply Lemma [1] to "0*1 so that there exists a summable sequence 
z* = {z*{j) : j G Z+} such that 1/V'*(A) = T,T=o^*U)^^ \M < 1- Therefore, 
for |A| < R we have 

11 .00 00 

Therefore 

CO 00 

^z*(j)i?-^A^"^V:i?-'=A'= = 1, |A| < R. 

j=0 k=0 
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Note that when i? = 1, we have z* — z in the notation of Lemma [T] Rearranging 
gives 

1=0 j=0 

Now comparing powers of A on both sides of this equahty gives 

n-l 

(6.1) Vo^*(0) = l, z*H = -EV':-,^*(j), ri>l. 

3=0 

Rearranging the second equation gives 

n-l 

R-''z*{n) = \i^h{n-j)R-^z*{j), n>l. 

3=0 

Observe that if i? = 1, z* satisfies (I3.6p . Define w{n) ~ R'"-z*{n) for n > 0. 
Then, by the uniqueness of the solution of (j3.6p . it is seen that w{n) = z{n), n >0 
and so z*{n) = R'''z{n), n > 0. Hence = T,°toz{j)X^, |A| < R and 

j:T=o^m' <+'^- 

Conversely, suppose that z is defined by p.6p and that J2'jLo ^(j)^"' < +oo. 
Multiplying across p.6p by i?" and summing gives 

oo oo 71 — 1 

n— 1 n— 1 J— 

Since the summand on the righthand side is non-negative, the order of summation 
may be exchanged to give 

oo oo oo 

z{n)R'' = 1 + Ai ^ b{j)W z{n)R". 

n— 3=^ n— 

Now, since X^^^o '^("')-^" ^ [liOo), it follows that MJ^JLi^U)^'' finite, and 
moreover the identity can be rearranged to give 

as required. □ 
6.1. Rates. It is obvious from p. 61) that if Ai J^JLi ^0)^ < 1 then 

oo _^ 

1 - Ai Ej=i &U)^ ^ 
and trivially X^jlo ■^(j)''"' ^ -^i ^(i)^"' < 1 fo'" ^ ^ (Oi !]■ 



Lemma 3. If be W{r) and Ai J^^i Kj)^^^ < 1. 

^(n) Ai 
lim — 



en 



(l-AiE,°li&(j>-^T' 
Proof of Lemma Apply Theorem |3] to p.6p . □ 

Lemma 4. If h E W"^(r) /or r e (0, 1], Ai X^jli ^(j)'" < 1; o^*^ Xz *s defined by 
then 

lim - 



fe->^ z(fc) I-AiEJIiKjV 
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Proof of Lemma\J^ Firstly, note that Ai 6(j)r ^ < 1 gives J2'jLo ^U)''^ < 

+00. Consider the case r < 1. Then for any fixed M > 2 we have 



Xz{n) 



z(n) 



z{n + j) 



z{n + j) 



- E ^(-'')^ 

j=M 



Let £ e (0,1) be such that r < r(l + e) < 1 < r ^. By Lemma [3] there is an 
N{e) e Z+ such that z{n + l)/z(n) < r(l + e) < 1 for aU n > N{e). Hence for 
j > 1, z{n + j)/z{n) < r^{\ + e)-?' < r"-?' for aU n > N{e). Thus for n > N{e), 



Xz{n) 



z(n) 



00 A/-1 

< 2 E ■Ai)r-' + E <i) 



zin + j) 



z{n) 



Since lim„_ 



z{n + j)/z{n) ~ , we have 
Xz{n) 



lim sup 



z{n) 



3=0 



< 2 E 

j=M 



Finally, letting M — 00 gives the desired result for r < 1. 

For the case r = 1, we split the sums in the same manner as above. From 
Lemma [3] we have that z G W(l). Then we use the asymptotic monotonicity of b 
to bound z{n + j)/ z(n). We have for n > Ni, for some A^i sufhciently large 

lim f(!^.Le (0,00), %^<^-i|^<2-2forall,>L 
n^oo t)(n) o[n) l{i^ + J) o(n) 

where 7 is the non-increasing sequence which is asymptotic to b. Thus for n > Ni 

z{n + i) ^ z{n + j) ^ b{n + j) ^ 6(n) ^ + j) 1^ ^ ^4 

z{n) b{n + j) b{n) z{n) ~ b{n) L ~ 



The result follows through as before. 



□ 



Proof of Theorems^ and\^ Theorem [5] and the second limit in Theorem 0] are an 
immediate consequence of Lemmas [3] and |4] with ( IS2D being required to guarantee 
that E[j/(0)^] is well defined and finite. 

Turning to the first limit formula in Theorem HI from Lemma HI we have that 
p £ W(l) and hence X^jlo P^^) ^ From (|3.7p we have 



(6.2) 



p{n + 1) = Ai E - J + l)p(j) + f{n), 
3=0 



where f{n) — Ai J2jLi ^(" + J + l)p(j)- Letting F{n) — Xib{n + 1) we can then 
apply Theorem |3] to get a representation for Lbp, providing that L^f and L^F 
both exist, and that J^JLo-^U) < 1- We have the last condition by assumption. 
To prove that LjF exists, note that 



Fin) 



lim 



lim 



Ai6(n + 1) Ai6(n+ 1) 7(n+ 1) 
— — = lim — — — — = Ai. 

7(71) n^oc 7(n+l) jin) 



As to the existence of Ljf, we fix AI G Z+, and make the estimate 



/(") 



7(n) 



AiE/^W 



M 

<ArE 



6(n + j + l) 



7(71) 
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For the second term on the right hand side we have 

bjn + 1 + j) ^ b{n + l+j) 7(n+l+j) ^ ^ 
j{n) j{n + l + j) 7(n) 

for aU n > Nq and some A'o sufRciently large. Thus for n > Nq, 

oo M 



f{n) 



7(n) 



Then 



i=i 



hm sup 



<3Ai pO0 + Ai^ 

j=M+l j = l 



pU)- 



/(") 



7(n) 



<3Ai j2 p^^y 

]=M+l 



Letting M -> oo gives L^f = Ai X^^i p{i)- 

Thus we may apply Theorem[31 which gives that L^p — L^p exists. Applying [51 
Theorem 4.3 ] to ((^ gives 



LbP 



AiE,°:oP(j)+AiE,°:iP(j) 
i-aie;:iKj) 



Using the symmetry of the autocovariance function, i.e., p{n) = p{~n) for all n G Z, 
gives (j4.9p as required. □ 

We provide a partial converse to Lemma[31 i.e., that z G W(r) implies b £ W{r). 
To do so, we state without proof a variant of [4, Theorem 3.7]. The proof of this 
consists of rewriting p.6p so that the roles of b and z are interchanged, and by then 
applying Theorem [31 

Lemma 5. Let z be the sequence which satisfies (j3.6l) . z G yV(r) and further 
suppose that 



(6.3) 

Then 



Ai5]&(j>"' < 



i=i 



b{n) 



lim 

n-i-oc 



Ai (Er=o^(j>-^ 



i?emarfc 11. If r e (0,1] and Ai 6(j)r-J < i, then z(j>-^ < 1, and 

hence Ai Y.T=i ^^^^^ < 5 ^'^^ z{jy < 1- 

We now state some preparatory lemmata which lead to converses of Theorems [31 
and [HI 

Lemma 6. Let z be the solution of p.6p and let (|6.3p hold with r G (0, 1]. Define 
the sequences {Um)m>i and (Lm)m>i by 

m oc 

Ui = 1, Um+i = l-Yl ^(jyLra, L„, = 1-^1 <jyUm, m G Z+/{0}. 



Then 



lim J7m = lim L„ = 1 - Ai ^(j>^ 
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Proof of Lemma\S[ The proof concentrates on verifying that hnim-s-oo CAn exists. 
Once this hmit is estabhshed it is easy to find hnim_j.oc im- We have Ui = I and 

Um+i = g{m) + a{m)Ujn, m > 1, 

where g{m) = 1 — X^jLi ^U)^'' ^-i^d a{m) = X]j!Li ^(j)''"' i An exphcit 

formula for U is given in e.g. [TH Exercise 2.1.17] and is 

m m m 

(6.4) (7™+! = n + E{ n «(J)}.9W' > 2, 

in which the usual convention Hjlm+i "^0) ^ applies. Also we note that g{m) — >■ 

1 — J2jLi •2^0)''"' and a(m) iJ^JLi ^U)'''^)'^ ^ (O7 l)i as m — i> 00. Thus the first 
term on the right-hand side of (j6.4p tends to zero as m — > 00 . Turning our attention 
to the second term we have 

^™ - h n;.i aij) '^""^ - nri^ - e:.2 + ^ ' 

where 

d{n) := ''^ . - , ., , c(n) := „„ , .. g(n). 

nj=ia(j) n;=i«(j) 11^=1 «o) 

Thus (i(n) — ^„ '^''a(j) ^"^^ hence c{n) — > oo and — > cxd as n — > oo. Moreover, 
c(n) 5(n) 1 - E"=i ^(J>^ 



and so 



lim 



d{n) 1 - a{n) 1 - E,^, z{j)r^ ELi ^i^V 
c{n) l-E,ti^(jV 1 



din) ( Y 1 + Er=i-0V 



Applying Toeplitz's Lemma (cf., e.g., [551 4.3.2 pp.390]) now gives 
lim - 1 



Therefore 

e:uch+c(i)_ 1 



lim (7™ = lim A„ = lim 

m-i-oo m-i-oo En=2 "("-) + S^l) ^ + Ej=l ^U)''^'' 

Finally, z may be written in terms of b using p. 61) . □ 
Lemma 7. Lef ( IS2P a?irf (|6.3I) /lo/d. If p ^ ^^{r), for r G (0, 1], i/ien z satisfies 

(6.5) < E[i/(0)2]liminf-^ < E[j/(0)2] limsup < U„i+i, m > 1, 

n^oo p(n) n^oo P\n) 

where U and L are the sequences defined in Lemma\^ 

Proof of Lemma The upper and lower bounds on z / p are established by an 
inductive proof. The bounds themselves are constructed recursively. Define P{n) = 
p(n)/E[z/(0)^]. We deal with the case when r e (0, 1): the proof for r = 1 is largely 
similar, but employs the asymptotic monotonicity of P to establish estimates for 
terms of the form P{n + j)/ P{n). 

From p.2p and using the non-negativity of z and definition of P, we have 
00 00 

(6.6) P{n) = ^z{j)z{n + j) = z{n) + ^z{j)z{n + j) > z{n). 

3=0 j=i 
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Thus z{n)/P{n) < 1 and so \im su'p,^_^^ z{n)/ P{n) < 1 = Ui. As lini„^oo ^(?^ + 
1)/P{n) = r we have for ah e > fixed that there exists an No{e) E Z+ such that 
P{n+j)/P{n) < r^{l + ey < 1 < r^^ for aU n > Na{e). Fix M e Z+. Let n > Nq. 
Thus by (Ell) 

oo ^ oo 



^ OO ^ oo 



M 



M oo 

<^z(jV(l + e)^"+ ^(^>"'' 

3 = 1 j=M+l 



which gives 



^ ^ ' 3 = 1 ^ ' j=l j=AI+l 

Thus 

/ N A-/ OO 

Hence 

, s Af oo 

liniinf|f{>l-^z(jV(l + f)^- E ^0>"'- 
^ ' i=i j=J\/+i 

Let e from the right, then let M — oo to get 

hminf 1^ > 1 - V z{jy =L,>0, 

n=roo pin) ^ — ' 



where the fact that Li > is a consequence of assumption 

The lower bound L\ is used then to determine the upper bound Vi: we rewrite 
(I6.6P according to 

oo 

z{n) + z{n + l)z(l) = Pin) - ^ z{j)z(n + j) < P{n). 

Since liminf„_j.oo z(n)/ P{n) > Li, for all e G (0, 1) there exists an N^ie) e Z+ such 
that for all n > Ns(e) 

Hence as P{n + 1)/P{n) ^ r as n ^> oo, we get 

limsup ^ < 1 - z(l)rLi(l - e). 

Let e from the right to get limsup^^g^ z(7i)/P(n) < 1 — z(l)rPi = U2- 
Therefore we have established (j6.5p for m = 1. 

Regarding the induction step at level m for to > 2, assume that (j6.5p holds, i.e., 

z{ti\ z{ti\ 
limsup — — < Urn, liniinf — — > 

n^oo P(n) "^cx) P(n) 

This implies that, for all e > sufficiently small, there exists -/Vi(e) > such that 
z[n)/P{n) < Um{l + e) for all n > Ni{e). 
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Fix M e Z+, and let -/Vo(e) be as defined above. Then for n > max(A'^i(e), No{e)), 
we note tliat 

p(„) ^^'p{n + j) P{n) y-l) ™^ ) p(„) 



j = l ^ j=M+l ^ ' 

M oo 

3 = 1 3=M+1 



Hence 



P(n) P(n) ^ 



^""-^ i=i i=Af+i 



whicli rearranges to give 

' M 



liminf 1^ > 1 - C/„(l + ,) I ^ z{jy{l + ey + ^ z{j) 



j=l 3=M+1 



having taken the limit inferior as n — > oo. Letting e — 5- from the right, and then 
letting M ^ oo, gives 



liminf > 1 - Um V zuy = L,n. 

n->oo P(n) -"^ — ' 



3 = 1 



This yields the lower limit in (j6.5p at level m + 1 . 

It remains to show that the upper limit in (j6.5p holds at level m + 1. To prove 
this, we start by rewriting (|6.6I) in the form 



■{n) + ^z{j)z{n + j) + y z{j)z{n + j) = P{n), 

j = l j=m+l 



which gives 



f ) 1 ™ 1 °° 

(6-7) ^ + 7^ E -OX- + ■^■) = 1 - 7^ ^. E ^ ^(^x- + ■^■) ^ 1- 

Since liminf „^oo z{n)/P{n) > L^, for every e e (0, 1) there is an 7V2(e) G Z+ such 
that n > N2{e) implies z{n)/P{n) > L„j(l — e). 
Let n > ma,x{N2{e),No{e)). Then 

1 / -x / -x / -x -S^C'^ + i) + j) /-x-PC^+jOr /-, X 



^ '-"PCn + j) P(n) " P(n) 
Inserting this estimate into (|6.7p and rearranging yields 
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Therefore, using the positivity of P and z, we get 

z{n) ( N + 

limsup— — <l + hmsup -L,„(l-£)^z(j) 

= 1 - hminf ff]z(j)^^§^)i,„(l - e). 

Since P{n + j)/P{n) as n ^ oo, and the sum contains only finitely many 

terms, we have that 

Hence 

limsup |f( < 1 - 5] <J>^im(l - e). 
Letting e — > 0+ yields 

z(n) ™ 

limsup — — < 1 ~ X! ^Uy^^rn = Ujn+l, 

by the definition of Um+i- Thus we have shown that if the m-th level statement in 
([^3)1 holds, then 

z(ti) z(ti) 
L„i < liminf — — < limsup — — < U„i+i, 

which is the (m + l)-th level statement in (j6.5p . This completes the proof of the 
general induction step, and since we have already shown that (I6.5P holds for m — 1, 
the lemma is true. □ 

Proof of Theorems\^and^ The implication that h G W~''(r) gives rise to p € 
'W^{r), for r £ (0, 1] is nothing other than the subject of Theorems |4] and |6l The 
converse result that p G W^^r) implies 6 € W"^(r), for r £ (0, 1], is an immediate 
consequence of Remark [TT] and Lemmas \S\ [5] and [7] with ( IS2D being required to 
guarantee that E[z^(0)^] is well defined and finite. 

It can be seen that the sequence Um and L,„ have the same limit as m 00. 
By virtue of Lemma [6l we may take the limit as m —t- 00 on both sides of (16. 5p , 
which yields lim„_>.oo z[n) / P{n) = limm->.oo = liinm_i.oo Um+i, from which the 
result follows. □ 

6.2. Bounds. The proof of Theorem [5] uses a result concerning the boundedness 
of linear Volterra operators in [51, Theorem 5.1]. We state a scalar variant of this 
theorem. Consider the non-convolution linear Volterra summation equation 

n 

(6.8) z{n+l) = ^H{n,i)z{i), neZ+: 

i=0 

where z(0) = e M and i? : Z+ x Z+ ^ M with H(n, i) = for i > n. 

Lemma 8. Suppose that there are integers M and N with < M < N such that 

n M 

sup < 1, sup |i/(7i, i)| < -l-cxD. 

n>N . n>M „ 

— i=M — 1=0 

Then there is K > independent of zq such that the solution of equations (|6.8p 
satisfies \z{n)\ < K\zo\ for n > 0. 
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Proof of Theorem\^ We deal here only with the case r — 1. The case r < 1 
follows the same steps as that of r = 1. We firstly show that z/7 is bounded. In 
order to write (j3.6p as a convolution equation we define = \ib{n + 1). Thus 
P{n) < Coj{n) for some Cp > and all n. Then defining x = z/7 and using (j3.6p . 
we have 

n 

a:(n + l) =^iJ(n,j>0-), n > 0, x(0) = 1/7(0), 
j=o 

where 

H(n,j):^ — — -, n>j>0. 

7(n) 7(n+l) 

To show the boundedness of x we apply Lemma [SI That is, we must show that 



Wh '■= lim limsup > H{n,j) < 1 



j = N 



and Hm '■= sup„>^/ ^^£q i7(r7,, j) is finite for each M G Z+. By the definition of 
H and we get 

limsup y H[n,j) — limsup > — — . 

j=N j=N ^^"■^ 

Let n > 2N. Then 

j=JV ^ 1=0 ' 1=0 ' l=N ' 

Thus by (1131) 

n N-1 n-N , 



limsup E H{n,j) < E /^(O +Cohmsup E 

J = 

and by (|4.4p we get 



n^oo ^.^j^ n^oo 7('^) 



W/f = lim limsup > H{n,j) 

Z=0 i=7V 1=0 

SO Wh < 1 as required. Now to show that for each fixed M, Hm is bounded, we 
note for n > M that 

\^H( ■) ^ V ~ - j) 7(n) 

f^o ,t^^("-J') 

and so sup„>^j i?A/("-) is finite and therefore x is bounded. As a bound on the 
resolvent is established, it just remains to deduce the bound on the autocovari- 
ance function. Moreover, it is immediate from x(n) = z{n)/^{n) < Ci that z is 
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summable. Hence 

OO OO / .s^ oo 

p{n) = GJ2 ^OX" + j) < GC, J2 zU)^^^^^lin) < GC,^{n) ^ z^'), 

and the desired result holds, where G = E[z/(0)^]. □ 

Proof of Theorem\ll\ First let us suppose that limsup„_yoo 6(n)/7(n) =: L3 G 
(0,00). Then from jSl]), 

limsup^T > Aip(ryi3 >0, 

where j* is the integer introduced in ( |AiD . Furthermore, for any fixed e > there 
exists an N{f) G Z+ such that h{n) < ^3(1 + e)7(n.) for all n > N{e). Moreover, 
b{n) < Ce^{n) for all n > 1, where — max{L3(l + e), supi<j<jv(e) b{j)/l{j)}- 
Therefore, from Theorem |5] we have that there exists Ci^c > such that p{n) < 
Ci^e7(n) for all n > 1. Thus, 

< Xip{j*)L3 < limsup 4^ < Ci e < 00. 

Conversely, suppose now that limsup„_).o2 p(n)/7(n) —: L2 G (0,oo). Then from 
([5?T1) we have limsup„^oo 5(n)/7(n) < L2/ {\ip{j*)r^' ) < +00. 

To show that limsup„^QQ b{n)/j{n) > 0, we suppose the contrary, namely that 
limsup„_^oQ b{n)/j{n) = 0. Since b and 7 are non-negative, lim„_^oo b{n)/j{n) = 0. 
Then it is not difficult to see from the proof of Theorem[4]that lim„_j.oo p{n)/^{n) = 
and hence lim sup^^o^ p{n) /j{n) = 0, which contradicts lim sup„_^o2 p{n) /j{n) > 
0. Therefore, as limsup„_j.Q^ b{n)/"/{n) must exist, we have limsup„_j.Qo b{n) /"f{n) G 
(0,cx)). □ 

Proof of Theorem The proof is largely established by rewriting the limits in 
terms of their e — N definition. This delivers upper and lower bounds, 7_,74_ 
respectively, on b where 7-(ri) = C-{n + l)"^!^^"*^) and 7+(n) = Cj^{n + 
for n > and for some constants C_,C+ > 0. Theorems [51 1^ and [TUl are then 
applied to generate the appropriate bounds on p, from which the result follows. 
In order to establish dn]), i.e. 

logp(n) log6(n) 
hmsup — ; — —p implies limsup — = —p, 

n^oo lOgn n^oo lOg n 

one uses (jS.ip and an argument by contradiction, not unlike that employed in the 
proof of Theorem [TT] 

For the case /3 — 00, the bounding function is where K > can be chosen 
arbitrarily large. In all other respects this case follows through as for other values 
of/?. □ 

Proof of Theorem\13[ Firstly suppose p{k) < C2Q;f . By definition, 6 > and hence 
z > and p > 0. Thus with j* as defined in ( |AiD , from (|5.ip wc have 



vn , 1 , ■*\ ^ 1 n , i \ ^ G2 k+i G2 k+i+j' 

b{k + l+j < - — TT:^p{k + 1 < T — TT^ar^ = - — -——a 

Hence, b{k) < C3,a\ for all k > j* + I where C3 = C2/(Aip(j*)Q!^ ) and so 
b{k) < Cia.2 for all k>\, where C4 = max(C3,Q) and Q = maxi</<j* b{l)a2^ = 
6(j*)V*. 

Conversely, suppose that b{k) < CiaJ;'. As ( [Si] ) holds we have z{n) — >■ 0, as 
TT, 00. Thus we may use [151 Theorem 4] to conclude that 

(6.9) b{k) < Cia\ if and only if z{k) < da^, 
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for some a4 G (0,1) and Ci,C4 G (0,oo). Therefore for the sequence / given in 
we get 

oo oo oo 

/(fc) - Ai ^ b{k + J + l)p{~j) < AiCi J2 < AiCiaiaf ^ p{j). 

j=i i=i i=i 

Thus as p is summable from Theorem [2j we have /(fc) < XiCiKai, for some 
< -fC < oo. Using this estimate for / and (I6.9P in (|3.8p gives 

A: k 



(6.10) p(fc) < Csa^ + y da'l-'Cea', = Cga^ + Cja^ V ( ^ 

If ai ^ q;4, with a2 =max(ai,a4) we have p{k) < C^a'l + Cs,\a'l — a^l < C^a^ + 
Cgal + Csa^ < Cgaf. If ai = a^, then 

/9(/c) < C^al + C'ra^k < C^al + CrCaiai + e)''^ < Cio(a4 + e)'', 

where a2 = 0:4 + e and e is chosen sufficiently small so that a2 < 1, and Cs is given 
by Cg = supfc>i fc/(l + e/a4)''. □ 
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